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(54) Stereoscopic picture obtaining device 

(57) Two pictures of a subject obtained by objective 
lenses 101 and 1 02 from different locations of viewpoint 
are respectively rotated by dove prisms 1 03 and 1 04, 90 
degrees clockwise, and then merged into a single pic- 
ture by total reflection mirrors 105 to 108. The picture 
after synthesis is reduced at a predetermined ratio by a 
condenser lens 109, and then projected onto a pickup 



plane of a CCD 110. It is therefore possible to obtain 
stereoscopic pictures having parallax as a single picture 
using a single camera without narrowing the effective 
fields of view of right and left pictures of different view- 
points. 
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Description 

BACKGROUND OF THE INVENTION 
Field of the Invention 

[0001 ] The present invention relates to stereoscopic 
picture obtaining devices, and more specifically to a 
stereoscopic picture obtaining device for obtaining two 
stereoscopic pictures having parallax. 

Description of the Background Art 

[0002] A method in which two cameras simultane- 
ously shoot the same subject from different locations of 
viewpoint to measure the three<Jimensional position of 
the subject based on parallax information of two shot 
pictures has been known (hereinafter referred to as first 
background art). An exemplary method of this type is 
described in "Image of 3D Space-Mathematical Geom- 
etry", pp. 142-143, Kbichiro Deguchi, published by 
Shokodo. May, 1991 (ISBN4-7856-2125-7C3355). 
[0003] Japanese Patent Laying-Open No. 7-248212 
discloses a method of obtaining a stereoscopic picture 
including parallax information by use of a single camera 
(hereinafter referred to as second background art). A 
three-dimensional shape measuring device according 
to the second background art is so structured as that 
four mirrors are provided in front of a camera, simulta- 
neously capturing a left picture from a left viewpoint and 
a right picture from a right viewpoint, and that the 
obtained left and right pictures are entered into left-half 
and right-half fields of view, respectively, of the single 
camera. 

[0004] The above first background art obtains a ster- 
eoscopic picture using two cameras and therefore 
requires two picture systems, resulting in a large system 
structure and high costs. 

[0005] On the other hand, in the above second back- 
ground art, the field of view of the single camera is 
divided into halves, a left-half and a right-half, and these 
two fields of view after division independently capture 
left and right pictures. Therefore, the angle of view when 
the subject is viewed from one of the fields of view after 
division becomes half the angle of view when viewed 
from the entire field of view of the camera. This will be 
described more specifically referring to FIG. 1 1 . Assum- 
ing that the picture size of the entire field of view in the 
camera is, for example, 640*480 pixels, a left picture 
and a right picture when shot in full size are represented 
by a left picture 1101 and a right picture 1 1 02 in FIG. 1 1 . 
However, these left and right pictures 1101 and 1102 
are too large to be stored as they are, in the left and 
right fields of view, respectively. Therefore, portions of 
the left picture 1101 in areas b and c (320*480 pixels) 
are stored in the left field of view of the camera, and por- 
tions of the right picture 1 102 in areas f and g (320*480 
pixels) are stored in the right field of view of the camera. 



That is, the effective fields of view in the lateral direction 
of the left and right pictures 1101 and 1102 become 
half. As a result, pictures of peripheral parts a and d of 
the left picture 1101 and pictures of peripheral parts e 
5 and h of the right picture 1102 are disadvantageous^ 
eliminated. This does not allow parallax information of 
the whole subject to be obtained, causing difficulty of 
measuring the three-dimensional position. 

10 SUMMARY OF THE INVENTION 

[0006] Therefore, an object of the present invention is 
to provide a stereoscopic picture obtaining device capa- 
ble of obtaining a single stereoscopic picture having 
is parallax from two picture with a wide effective field of 
view. 

[0007] The present invention has the following various 
features to achieve the object above. 
[0008] A first aspect of the present invention is 
20 directed to a stereoscopic picture obtaining device for 
obtaining a stereoscopic picture with parallax by a sin- 
gle camera, comprising: 

two objective lenses for simultaneously obtaining 
25 two pictures of a subject from different locations of 
viewpoint; 

picture merge means for merging the two pictures 
obtained by the two objective lenses into a single 
picture through optical operation; 
30 picture reducing means for reducing the single pic- 
ture after synthesis by the picture merge means at 
a predetermined reduction ratio and projecting a 
picture onto a predetermined projection plane; and 
an image pickup device for converting the picture 
35 projected onto a pickup plane which is arranged on 
the projection plane into image data. 

[0009] As described above, in the first aspect, two pic- 
tures of a subject obtained by the two objective lenses 

40 from different locations of viewpoint are merged into a 
single picture, and then reduced to be projected onto 
the image pickup device. It is therefore possible to 
obtain a single stereoscopic picture with parallax with- 
out narrowing the effective fields of view of the two pic- 

45 tures. 

[0010] According to a second aspect, in the first 
aspect, 

the stereoscopic picture obtaining device further 
so comprises, in any position of order of the objective 
lenses through the image pickup device: 
picture rotating means for rotating the picture or pic- 
tures through optical operation. 

55 [0011] As described above, in the second aspect, 
when two stereoscopic pictures are not well fit into the 
pickup plane of the image pickup device, it is possible to 
correct the relation in positions between two pictures by 
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rotation. 

[0012] According to a third aspect, in the second 
aspect, 

the picture rotating means rotates the two pictures 
obtained by the two objective lenses before synthe- 
sis by the picture merge means; and 
the picture merge means merges the two pictures 
rotated by the picture rotating means into a single 
picture. 

[0013] According to a fourth aspect, in the second 
aspect, 

the picture rotating means rotates the picture after 
synthesis by the picture merge means. 

[0014] According to a fifth aspect, in the second 
aspect, 

the picture rotating means rotates the picture or pic- 
tures 90 degrees. 

[001 5] According to a sixth aspect, in the first aspect. 

the picture merge means arranges the two pictures 
obtained by the two objective lenses on right and 
left and generates a single merged picture. 

[0016] According to a seventh aspect, in the first 
aspect, 

the picture merge means arranges the two pictures 
obtained by the two objective lenses on top and bot- 
tom and generates a single merged picture. 

[0017] According to an eighth aspect, in the first 
aspect, 

the stereoscopic picture obtaining device further 
comprises: 

aspect ratio changing means for reducing/enlarging 
the two pictures obtained by the two objective 
lenses through optical operation before synthesis 
by the picture merge means, thereby changing an 
aspect ratio of each of the two pictures. 

[0018] As described above, in the eighth aspect, by 
changing each aspect ratio of the two pictures obtained 
by the two objective lenses, it is possible to almost com- 
pletely match the size of the merged picture after reduc- 
tion with the size of the pickup plane of the image pickup 
device. 

[001 9] A ninth aspect is directed to a stereoscopic pic- 
ture obtaining device for obtaining a stereoscopic pic- 
ture with parallax, comprising: 

two image taking means for shooting a subject from 



different locations of viewpoint and generating two 
sets of image data having parallax; 
image merge means for merging the two sets of 
image data generated by the two image taking 
s means into a single set of image data through elec- 
trical operation; 

image reducing means for reducing the single set of 
image data after synthesis by the image merge 
means at a predetermined reduction ratio through 
10 electrical operation; and 

storage means for storing image data after reduc- 
tion by the image reducing means. 

[0020] As described above, in the ninth aspect, two 
15 sets of image data having parallax, generated by two 
image taking means, are merged into a single set of 
image data, and then reduced to be stored in the stor- 
age means. It is therefore possible to obtain a single set 
of image data having parallax without narrowing the 
20 effective fields of view of the two sets of image data, 
resulting in a small capacity of the storage device. 
[0021 ] According to a tenth aspect, in the ninth aspect, 

the stereoscopic picture obtaining device further 
25 comprises, in any position of order of the image tak- 
ing means through the storage means: 
image rotating means for rotating the image data 
through electrical operation. 

30 [0022] As described above, in the tenth aspect, when 
the two sets of image data are not well fit into the frame 
size of the storage means, it is possible to correct the 
relation in positions between the image data by rotation. 
[0023] According to an eleventh aspect, in the tenth 

35 aspect, 

the image rotating means rotates the two sets of 
image data generated by the two image taking 
means before synthesis by the image merge 
40 means; and 

the image merge means merges the two sets of 
image data rotated by the image rotating means 
into a single set of image data. 

45 [0024] According to a twelfth aspect, in the tenth 
aspect, 

the image rotating means rotates the image data 
after synthesis by the image merge means. 

50 

[0025] According to a thirteenth aspect, in the tenth 
aspect, 

the image rotating means rotates the image data 90 
55 degrees. 

[0026] According to a fourteenth aspect, in the ninth 
aspect, 
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the image merge means arranges the two sets of 
image data generated by the two image taking 
means on right and left and generates a single set 
of image data. 

[0027] According to a fifteenth aspect, in the ninth 
aspect, 

the image merge means arranges the two sets of 
image data generated by the two image taking 
means on top and bottom and generates a single 
set of image data. 

[0028] According to a sixteenth aspect, in the ninth 
aspect, 

the image reducing means reduces the single set of 
image data after synthesis by the image merge 
means, thereby changing an aspect ratio of the sin- 
gle image data. 

[0029] As described above, in the sixteenth aspect, by 
changing the aspect ratio of the image data after syn- 
thesis by the image merge means, it is possible to 
almost completely match the size of the merged image 
after reduction with the frame size of the storage means. 
[0030] These and other objects, features, aspects and 
advantages of the present invention will become more 
apparent from the following detailed description of the 
present invention when taken in conjunction with the 
accompanying drawings. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0031] 

FIG. 1 is a diagram showing the structure of a ster- 
eoscopic picture obtaining device according to a 
first embodiment of the present invention; 
FIG. 2 is a flow chart showing operation of the ster- 
eoscopic picture obtaining device as shown in FIG. 
1; 

FIG. 3 is a diagram showing changes of obtained 
pictures in the stereoscopic picture obtaining 
device as shown in FIG. 1 ; 
FIG. 4 is a diagram showing the structure of an opti- 
cal system of a stereoscopic picture obtaining 
device according to a second embodiment of the 
present invention; 

FIG. 5 is a diagram showing changes of obtained 
pictures in the stereoscopic picture obtaining 
device as shown in FIG. 4; 
FIG. 6 is a diagram showing changes of pictures in 
the stereoscopic picture obtaining device as shown 
in FIG. 4 when a lens for enlargement in the lateral 
direction is used as a reducing/enlarging lens; 
FIG. 7 is a block diagram showing the structure of a 
stereoscopic picture obtaining device according to 



a third embodiment of the present invention; 
FIG. 8 is a flow chart showing operation of the ster- 
eoscopic picture obtaining device as shown in FIG. 
7; 

s FIG. 9 is a diagram showing an example of rotation 
information registered in a rotating direction angle 
setting table in FIG. 7; 

FIG. 10 is a diagram showing an example of syn- 
thesis information registered in a synthesis-related 
10 information setting table in FIG. 7; and 

FIG. 11 is a diagram for describing that a field of 
view is restricted in a conventional stereoscopic pic- 
ture obtaining device. 

15 DESCRIPTION OF THE PREFERRED EMBODIMENT 

(First embodiment) 

[0032] FIG. 1 is a diagram showing the structure of a 

20 stereoscopic picture obtaining device according to a 
first embodiment of the present invention. In FIG. 1, the 
stereoscopic picture obtaining device of the present 
embodiment includes objective lenses 101 and 102 
spaced a certain distance apart, a dove prism 103 pro- 

25 vided corresponding to the objective lens 101, a dove 
prism 104 provided corresponding to the objective lens 
102, total reflection mirrors 1 05 and 107 provided corre- 
sponding to the objective lens 101, total reflection mir- 
rors 106 and 108 provided corresponding to the 

30 objective lens 102, a condenser lens 109, and a CCD 
1 10 which is a solid state image pickup device. 
[0033] FIG. 2 is a flow chat showing operation of the 
stereoscopic picture obtaining device as shown in FIG. 
1 . FIG. 3 is a diagram showing changes of obtained pic- 

35 tures in the stereoscopic picture obtaining device as 
shown in FIG. 1 . Described below is the operation in the 
embodiment shown in FIG. 1 referring to FIGS. 2 and 3. 
[0034] First, the objective lenses 101 and 102 spaced 
a distance B mm apart simultaneously obtain pictures of 

<o a subject (not shown) from different locations of view- 
point (step S1). In FIG. 3, a picture 301 represents a pic- 
ture obtained by the objective lens 101, and a picture 
302 represents a picture obtained by the objective lens 
102. Note that, for clear understanding of the field of 

45 view size, it is assumed herein that a picture of 640*480 
pixels, which is equal to the size of a video signal, 
passes through the objective lenses 101 and 102. 
[0035] The pictures 301 and 302 obtained at the same 
time by the objective lenses 101 and 102 are rotated 90 

so degrees clockwise by the dove prisms 103 and 104, 
respectively (step S2). In FIG. 3, a picture 303 repre- 
sents a picture after rotation by the dove prism 1 03, and 
a picture 304 represents a picture after rotation by the 
dove prism 104. The pictures 303 and 304 after rotation 

55 (480*640 pixels) are the same size as the pictures 301 
and 302 (640*480 pixels), with each aspect (length-to- 
width) ratio reversed. The rotating direction of the pic- 
tures obtained by the objective lenses 101 and 102 is 
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easily changeable by changing the setting direction of 
the dove prisms 103 and 104. 
[0036] The pictures 303 and 304 after rotation by the 
dove prisms 103 and 104 are reflected by the total 
reflection mirrors 105 and 106, respectively, and pro- 
jected onto the total reflection mirrors 107 and 108 (step 
S3). 

[0037] The total reflection mirrors 107 and 108 reflect 
the projected pictures 303 and 304, respectively, so that 
the progressing directions of the pictures become paral- 
lel to each other, thereby merging the pictures 303 and 

304 into a single picture (step S4). In FIG. 3, a picture 

305 represents a picture after synthesis. The picture 
after synthesis becomes 960*640 (=480*640+480*640) 
pixels in size. 

[0038] The picture 305 after synthesis (960*640 pix- 
els) is reduced at a predetermined reduction ratio by the 
condenser lens 109, and projected onto a pickup plane 
of the CCD 110 (step S5). In FIG. 3, a picture 306 is a 
picture projected onto a pickup plane 307 of the CCD 
110 after reduction by the condenser lens 109. Since 
the reduction ratio of the condenser lens 109 is 2/3 
(=0.666...) along any arbitrary perpendicular direction 
around an optical axis, the reduced picture 306 
becomes 640*427 pixels in size. 
[0039] As described above, according to the first 
embodiment, a single camera can obtain a stereoscopic 
picture with parallax without narrowing the fields of view 
of right and left pictures of different viewpoints. 
[0040] Although picture rotating operation is per- 
formed before picture merge operation in the above first 
embodiment, picture rotating operation may be per- 
formed after picture merge operation. 

(Second embodiment) 

[0041 ] FIG. 4 is a diagram showing the structure of an 
optical system of a stereoscopic picture obtaining 
device according to a second embodiment of the 
present invention. In FIG. 4, the stereoscopic picture 
obtaining device of the present embodiment includes 
objective lenses 401 R and 401 L spaced a certain dis- 
tance apart, first deflection prisms 402 R and 402L, 
reducing/enlarging lenses 403R and 403L, second 
deflection prisms 404 R and 404L, third deflection 
prisms 405 R and 405L, image reversing lenses 406 R 
and 406L. a merge prism 407, a condenser lens 408, 
and a CCD 409. 

[0042] In the above first embodiment, the right and left 
pictures obtained by the objective lenses 101 and 102 
are merged as they are, and then projected onto the 
pickup plane of the CCD 110. Therefore, as shown in 
FIG. 3, the length (427 pixels) of the reduced picture 

306 is a little shorter than the length (480 pixels) of the 
pickup plane 307 of the CCD 110. That is, in the first 
embodiment, the pickup plane 307 of the CCD 110 is 
not fully utilized. On the other hand, in the second 
embodiment, by changing the aspect ratio of the right 



and left pictures obtained by the objective lenses 401 R 
and 401 L before merging them, the pickup plane of the 
CCD 409 can be fully utilized. 
[0043] FIG. 5 is a diagram showing changes of 

5 obtained pictures in the stereoscopic picture obtaining 
device as shown in FIG. 4. Described below is operation 
of the embodiment shown in FIG. 4 referring to FIG. 5. 
[0044] First, the objective lenses 401 R and 401 L 
spaced a certain distance apart simultaneously obtain 

w pictures of a subject (not shown) from different locations 
of viewpoint. In FIG. 5, a picture 501 represents a pic- 
ture obtained by the objective lens 401 R, and a picture 
502 represents a picture obtained by the objective lens 
401 L Note that, for clear understanding of the field of 

is view size, it is assumed herein that a picture of 640*480 
pixels, which is equal to the size of a video signal, 
passes through the objective lenses 401 R and 401 L 
[0045] The pictures 501 and 502 obtained at the same 
time by the objective lenses 401 R and 401 L are 

20 deflected in the progressing directions by the deflection 
prisms 402R and 402L, and entered into the reduc- 
ing/enlarging lenses 403R and 403L, respectively. The 
reducing/enlarging lenses 403R and 403L reduce only 
the size in the longitudinal direction of the pictures 501 

25 and 502, respectively. That is, the reducing/enlarging 
lenses 403R and 403L reduce the pictures 501 and 502, 
respectively, to change each aspect ratio. As the reduc- 
ing/enlarging lenses 403R and 403L, a cylindrical lens 
may be used. In FIG. 5, a picture 503 represents a pic- 

30 ture reduced by the reducing/enlarging lens 403R, and 
a picture 504 represents a picture reduced by the reduc- 
ing/enlarging lens 403L At this time, the picture 501 of 
640*480 pixels is reduced to the picture 503 of 640*426 
pixels, while the picture 502 of 640*480 pixels is 

35 reduced to the picture 504 of 640*426 pixels. The 
reduced picture 503 which passed through the reduc- 
ing/enlarging lens 403R is deflected in the progressing 
direction by the deflection prisms 404R and 405R, and 
then reversed by the image reversing lens 406 R to be 

40 entered into a first reflecting surface 407a of the merge 
prism 407. The reduced picture 504 which passed 
. through the reducing/enlarging lens 403L is deflected in 
the progressing direction by the deflection prisms 404L 
and 405U and then reversed by the image reversing 

45 lens 406L to be entered into a second reflecting surface 
407b of the merge prism 407. 
[0046] The merge prism 407 reflects the entered, 
reduced pictures 503 and 504 so that their progressing 
directions are parallel to each other, thereby merging 

so these reduced pictures 503 and 504 into a single pic- 
ture. In FIG. 5, a picture 505 represents a picture after 
synthesis. The picture 505 after synthesis becomes 
640*852 (=640*426+640*426) pixels in size. 
[0047] The picture 505 after synthesis is reduced at a 

55 predetermined reduction ratio by the condenser lens 
408 and projected onto a pickup plane of the CCD 409. 
In FIG. 5, a picture 506 represents a picture projected 
onto the pickup plane of the CCD 409 after reduction by 
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the condenser lens 408. Since the reduction ratio of the 
condenser lens 408 is 3/4 (=0.75) along any arbitrary 
perpendicular direction around an optical axis, the 
reduced picture 506 becomes 480*640 pixels in size. 
Since the size of the pickup plane of the CCD 409 is 
480*640 pixels, the pickup plane of the CCD 409 can be 
fully utilized in the second embodiment. 
[0048] Although the reducing/enlarging lenses 403R 
and 403L reduce the size in the longitudinal direction of 
the pictures 501 and 502, respectively, in the above sec- 
ond embodiment, they may enlarge the size in the lat- 
eral direction. FIG. 6 shows changes of pictures in the 
stereoscopic picture obtaining device as shown in FIG. 
4 when a lens for enlarging the size in the lateral direc- 
tion is used for the reducing/enlarging lenses 403R and 
403L Described below is operation of another example 
of the embodiment shown in FIG. 4 referring to FIG. 6. 
[0049] In FIG. 6, the pictures 501 and 502 obtained by 
the objective lenses 401 R and 401L are deflected in the 
progressing direction by the deflection prisms 402R and 
402L, respectively, and entered into the reduc- 
ing/enlarging lenses 403R and 403L As described 
above, the reducing/enlarging lenses 403R and 403L 
enlarge the size of the pictures 501 and 502, respec- 
tively, only in the lateral direction. In FIG. 6, a picture 
503' represents a picture enlarged by the reduc- 
ing/enlarging lens 403R, and a picture 504' represents a 
picture enlarged by the reducing/enlarging lens 403L. In 
the present example, the picture 501 of 640*480 pixels 
is enlarged to the picture 503' of 720*480 pixels, while 
the picture 502 of 640*480 pixels is enlarged to the pic- 
ture 504* of 720*480 pixels. The enlarged picture 503' is 
deflected in the progressing direction by the deflection 
prisms 404R and 405R, and then reversed by the image 
reversing lens 406R to be entered into the first reflection 
surface 407a of the merge prism 407. The enlarged pic- 
ture 504' is deflected in the progressing direction by the 
deflection prisms 404L and 405L, and then reversed by 
the image reversing lens 406L to be entered into the 
second reflection surface 407b of the merge prism 407. 
[0050] The merge prism 407 reflects the entered, 
enlarged pictures 503' and 504' so that their progress- 
ing directions are parallel to each other, thereby merg- 
ing these enlarged pictures 503' and 504' into a single 
picture. In FIG. 6, the picture 505* represents a picture 
after synthesis. The picture 505' after synthesis 
becomes 720*960 (=720*480+720*480) pixels in size. 
[0051 ] The picture 505' after synthesis is reduced at a 
predetermined ratio by the condenser lens 408 and pro- 
jected onto the pickup plane of the CCD 409. In FIG. 6, 
a picture 506* represents a picture projected onto the 
pickup plane of the CCD 409 after reduction by the con- 
denser lens 408. Since the reduction ratio of the con- 
denser lens 408 is 2/3 (=0.666...) along any arbitrary 
perpendicular direction around an optical axis, the 
reduced picture 506' becomes 480*640 pixels in size. 
[0052] In the above first embodiment, the obtained 
pictures are reversed 90 degrees before merged. In the 



above second embodiment, however, the aspect ratio of 
the pictures obtained by the objective lenses has a 
reverse relation with the aspect ratio of the CCD 409, 
and therefore it is not required to rotate the obtained pic- 
5 tures before merging them. As evident from the above, 
picture rotating operation is not absolutely necessary for 
the present invention. The same goes for a third embod- 
iment which will be described below. 

10 (Third embodiment) 

[0053] FIG. 7 is a block diagram showing the structure 
of the stereoscopic picture obtaining device according 
to the third embodiment of the present invention. In FIG. 

15 7, the stereoscopic picture obtaining device of the 
present embodiment includes image taking devices 701 
and 702. image rotating devices 703 and 704, an image 
merge device 705, an image reducing/enlarging device 
706, a rotating direction angle setting table 707, a 

20 merge-related information setting table 708, a reduc- 
tion/enlargement ratio setting section 709, and frame 
memory 710. The image taking devices 701 and 702 
each include an objective lens and a CCD. Assume that 
a value representing a rotating direction of an image 

25 (hereinafter referred to as rotating direction value) is 
previously set in the image rotating devices 703 and 
704, and a value representing a merge state of images 
(hereinafter referred to as merge state value) is previ- 
ously set in the image merge device 705. Further, 

30 assume that reduction/enlargement ratios in the lateral 
and longitudinal directions of an image are set in the 
reduction/enlargement ratio setting section 709. 
[0054] FIG. 8 is a flow chart showing operation of the 
stereoscopic picture obtaining device as shown in FIG. 

35 7. Described below is the operation of the stereoscopic 
picture obtaining device according to the third embodi- 
ment referring to FIG. 8. 

[0055] First, the two image taking devices 701 and 

702 shoot a subject (not shown) from different locations 
40 of viewpoint to generate two sets of image data from dif- 
ferent locations of viewpoint (step S101). The two sets 
of image data outputted from the image taking devices 
701 and 702 are inputted to the image rotating devices 

703 and 704, respectively. The image rotating devices 
45 703 and 704 then take out rotation information corre- 
sponding to the preset rotating direction value from the 
rotating direction angle setting table 707 (step S102). 
FIG. 9 shows an example of the rotation information 
registered in the rotating direction angle setting table 

so 707. In FIG. 9. rotation information corresponding to "0" 
represents that an image is not rotated; rotation infor- 
mation corresponding to "1 " represents that an image is 
rotated 90 degrees clockwise; rotation information cor- 
responding to "2" represents that an image is rotated 

55 180 degrees clockwise; and rotation information corre- 
sponding to "3" represents that an image is rotated 270 
degrees clockwise. The image rotating devices 703 and 

704 then rotate the image data provided by the image 
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taking devices 701 and 702, respectively, based on the 
rotation information taken out from the rotating direction 
angle setting table 707. The image data rotating opera- 
tion itself has been an established technique called aff- 
ine transformation. More specifically, the image rotating 5 
devices 703 and 704 rotate the image data using a pre- 
determined transformation matrix equation, based on 
parameters provided by the obtained rotation informa- 
tion. 

[0056] The image merge device 705 then takes out 10 
merge information corresponding to the preset merge 
state value from the merge-related information setting 
table 708 (step S104). FIG. 10 shows an example of the 
merge information registered in the merge-related infor- 
mation setting table 708. In FIG. 10, merge information 15 
corresponding to a value "0" represents that the output 
image of the image rotating device 703 is arranged on 
the right, while the output image of the image rotating 
device 704 on the left; merge information corresponding 
to a value "1" represents that the output image of the 20 
image rotating device 703 is arranged on the left, while 
the output image of the image rotating device 704 on 
the right; merge information corresponding to a value 
"2" represents that the output image of the image rotat- 
ing device 703 is arranged on the top, while the image 25 
of the image rotating device 704 on the bottom; and 
merge information corresponding to a value "3" repre- 
sents that the output image of the image rotating device 
703 is arranged on the bottom, while the image of the 
image rotating device 704 on the top. The image merge 30 
device 705 then merges the image data provided by the 
image rotating devices 703 and 704 based on the 
merge information taken out from the merge-related 
information setting table 708 (step S105). 
[0057] The image reducing/enlarging device 706 then 35 
reads out the reduction/enlargement ratios set in the 
reduction/enlargement ratio setting section 709 (step 
S106). The image reducing/enlarging device 706 then 
enlarges/reduces the merged image data provided by 
the image merge device 705 according to the reduc- 40 
tion/enlargement ratios read out from the reduc- 
tion/enlargement ratio setting section 709 (step S107). 
The image reducing/enlarging device 706 then writes 
the enlarged/reduced image data in the frame memory 
710 (step S1 08). 45 
[0058] Described below is more specific operation 
with specific values provided for the above third embod- 
iment. Note that the following description of the opera- 
tion is merely an example, and other variations can be 
devised depending on other values provided. so 
[0059] Assume that the size of the image data to be 
outputted from the image taking devices 701 and 702 is 
640*480 pixels, and the pixel size of the frame memory 
703 is 640*480. Further, assume that "1" is previously 
set as the rotating direction value in the image rotating 55 
devices 703 and 704, and "0" is previously set as the 
merge state value in the image merge device 705. Still 
further, assume that 2/3 (=0.666...) in the lateral direc- 



tion and 3/4 (=0.75) in the longitudinal direction are set 
as the reduction ratios in the reduction/enlargement 
ratio setting section 709. Under these conditions, the 
image rotating devices 703 and 704 rotate the image 
data provided by the image taking devices 701 and 702, 
90 degrees clockwise, respectively. Therefore, the 
image data of 480*640 pixels is outputted from each of 
the image rotating devices 703 and 704. The image 
merge device 705 then generates merged image data in 
which the output image of the image rotating device 703 
is arranged on the right and the output image of the 
image rotating device 704 is arranged on the left. There- 
fore, the merged image data becomes 960*640 pixels in 
size. The image reducing/enlarging device 706 reduces 
the size of the provided merged image data by 2/3 
(=0.666...) in the lateral direction and by 3/4 (=0.75) in 
the longitudinal direction. Therefore, the size of the 
image data after reduction becomes 640*480 pixels. 
[0060] While the invention has been described in 
detail, the foregoing description is in all aspects illustra- 
tive and not restrictive. It is understood that numerous 
other modifications and variations can be devised with- 
out departing from the scope of the invention. 

Claims 

1. A stereoscopic picture obtaining device for obtain- 
ing a stereoscopic picture with parallax by a single 
camera, comprising: 

two objective lenses (1 01 , 102, 401 R, 401 L) for 
simultaneously obtaining two pictures of a sub- 
ject from different locations of viewpoint; 
picture merge means (107, 108, 407) for merg- 
ing the two pictures obtained by said two objec- 
tive lenses into a single picture through optical 
operation; 

picture reducing means (109, 408) for reducing 
the single picture after synthesis by said picture 
merge means at a predetermined reduction 
ratio and projecting a picture onto a predeter- 
mined projection plane; and 
an image pickup device (110, 409) for convert- 
ing the picture projected onto a pickup plane 
which is arranged on said projection plane into 
image data. 

2. The stereoscopic picture obtaining device accord- 
ing to claim 1 , further comprising, in any position of 
order of said objective lenses through said image 
pickup device: 

picture rotating means (103, 104) for rotating 
the picture or pictures through optical opera- 
tion. 

3. The stereoscopic picture obtaining device accord- 
ing to claim 2, wherein 
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said picture rotating means rotates the two pic- 
tures obtained by said two objective lenses 
before synthesis by said picture merge means; 
and 

said picture merge means merges the two pic- s 
tures rotated by said picture rotating means 
into a single picture. 

4. The stereoscopic picture obtaining device accord- 
ing to claim 2, wherein 10 

said picture rotating means rotates the picture 
after synthesis by said picture merge means. 

5. The stereoscopic picture obtaining device accord- is 
ing to claim 2, wherein 

said picture rotating means rotates the picture 
or pictures 90 degrees. 

20 

6. The stereoscopic picture obtaining device accord- 
ing to claim 1. wherein 

said picture merge means arranges the two 
pictures obtained by said two objective lenses 25 
on right and left and generates a single merged 
picture. 

7. The stereoscopic picture obtaining device accord- 
ing to claim 1 , wherein 30 

said picture merge means arranges the two 
pictures obtained by said two objective lenses 
on top and bottom and generates a single 
merged picture. 35 

8. The stereoscopic picture obtaining device accord- 
ing to claim 1, further comprising: 

aspect ratio changing means (403R, 403L) for 40 
reducing/enlarging the two pictures obtained 
by said two objective lenses through optical 
operation before synthesis by said picture 
merge means, thereby changing an aspect 
ratio of each of the two pictures. 4s 

9. A stereoscopic picture obtaining device for obtain- 
ing a stereoscopic picture with parallax, comprising: 

two image taking means (701 , 702) for shoot- so 
ing a subject from different locations of view- 
point and generating two sets of image data 
having parallax; 

image merge means (705) for merging the two 
sets of image data generated by said two ss 
image taking means into a single set of image 
data through electrical operation; 
image reducing means (706) for reducing the 



single set of image data after synthesis by said 
image merge means at a predetermined reduc- 
tion ratio through electrical operation; and 
storage means (710) for storing image data 
after reduction by said image reducing means. 

10. The stereoscopic picture obtaining device accord- 
ing to claim 9, further comprising, in any position of 
order of said image taking means through said stor- 
age means: 

image rotating means (703, 704) for rotating 
the image data through electrical operation. 

11. The stereoscopic picture obtaining device accord- 
ing to claim 10, wherein 

said image rotating means rotates the two sets 
of image data generated by said two image tak- 
ing means before synthesis by said image 
merge means; and 

said image merge means merges the two sets 
of image data rotated by said image rotating 
means into a single set of image data. 

12. The stereoscopic picture obtaining device accord- 
ing to claim 10. wherein 

said image rotating means rotates the image 
data after synthesis by said image merge 
means. 

13. The stereoscopic picture obtaining device accord- 
ing to claim 10, wherein 

said image rotating means rotates the image 
data 90 degrees. 

14. The stereoscopic picture obtaining device accord- 
ing to claim 9, wherein 

said image merge means arranges the two 
sets of image data generated by said two 
image taking means on right and left and gen- 
erates a single set of image data. 

15. The stereoscopic picture obtaining device accord- 
ing to claim 9, wherein 

said image merge means arranges the two 
sets of image data generated by said two 
image taking means on top and bottom and 
generates a single set of image data. 

16. The stereoscopic picture obtaining device accord- 
ing to claim 9, further comprising: 

said image reducing means reduces the single 
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set of image data after synthesis by said image 
merge means, thereby changing an aspect 
ratio of the single image data. 
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F I G. 2 




OBJECTIVE LENSES 
101, 102 OBTAIN TWO 
PICTURES FROM DIFFERENT 
LOCATIONS OF VIEWPOINT 



DOVE PRISMS ROTATE EACH 
PICTURE 90 DEGREES 
CLOCKWISE 

I 

TOTAL REFLECTION MIRRORS 
105, 106 REFLECT PICTURES 
AFTER ROTATION 

I ~ 

TOTAL REFLECTION MIRROR 
107, 108 MERGE PICTURES 



CONDENSER LENS 109 
REDUCES PICTURE AFTER 
MERGE 
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"start 




IMAGE TAKING DEVICES 701, 702 
CAPTURE TWO PICTURES FROM 
DIFFERENT LOCATIONS OF VIEWPOINT 



I 



OBTAIN CORRESPONDING ROTATION 
INFORMATION FROM ROTATING 
DIRECTION ANGLE SETTING TABLE 707 



-S101 



• S102 



ROTATE IMAGES BASED ON OBTAINED 
ROTATION INFORMATION 



.S103 



OBTAIN CORRESPONDING MERGE 
INFORMATION FROM MERGE-RELATED 
INFORMATION SETTING TABLE 708 



MERGE IMAGES BASED ON OBTAINED 
MERGE INFORMATION 



OBTAIN REDUCTION/ENLARGEMENT 
RATIO FROM REDUCTION/ENLARGEMENT 
RATIO SETTING SECTION 709 



.S104 



S105 



• S106 



REDUCE/ENLARGE IMAGE ACCORDING 
TO OBTAINED REDUCTION/ENLARGEMENT 
RATIO 



.S107 



WRITE REDUCED/ENLARGED IMAGE IN -" S108 
FRAME MEMORY 




END 
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